41 |
Code-switched English Pronunciation Modeling for Swahili Spoken Term Detection (Pub Version, Open Access)
|
|
|
|
BASE
|
|
Show details
|
|
42 |
Avaliação de nivelamento no programa de português para estrangeiros da UFRGS : uma proposta de novos instrumentos avaliativos de leitura e escrita
|
|
|
|
BASE
|
|
Show details
|
|
43 |
Perceptions of Eighth Grade State Writing Assessment at a Nationally Recognized Middle School
|
|
|
|
In: Theses, Student Research, and Creative Activity: Department of Teaching, Learning and Teacher Education (2016)
|
|
BASE
|
|
Show details
|
|
45 |
Evaluation in artificial intelligence: From task-oriented to ability-oriented measurement
|
|
|
|
BASE
|
|
Show details
|
|
47 |
Kompetenz von Lehramtsstudierenden in Deutsch als Zweitsprache. Validierung des GSL-Testinstruments
|
|
|
|
In: Blömeke, Sigrid [Hrsg.]; Zlatkin-Troitschanskaia, Olga [Hrsg.]: Kompetenzen von Studierenden. Weinheim u.a. : Beltz Juventa 2015, S. 32-54. - (Zeitschrift für Pädagogik, Beiheft; 61) (2015)
|
|
BASE
|
|
Show details
|
|
48 |
The eras and trends of automatic short answer grading
|
|
|
|
In: International journal of artificial intelligence in education 25 (2015) 1, S. 60-117 (2015)
|
|
BASE
|
|
Show details
|
|
49 |
An argument-based validation study of the English Placement Test (EPT) – Focusing on the inferences of extrapolation and ramification
|
|
|
|
In: Graduate Theses and Dissertations (2015)
|
|
Abstract:
English placement tests have been widely used in higher education as post-admission assessment instruments to measure admitted English as a second language (ESL) students’ English proficiency or readiness in academic English, usually upon their arrival at universities in English-speaking countries. Unlike commercial standardized English proficiency tests, many English placement tests are locally developed with comparatively limited resources and are relatively under-investigated in the field of language testing. Even less attention has been directed to the score interpretation and the impact of placement decisions on ESL students’ English learning and academic achievement. Undoubtedly, this scarcity of research on English placement tests is inappropriate in view of their status as one of the most frequently used language testing instruments, which may exert immediate and strong impact on ESL students’ learning in general. By employing a mixed-methods approach, this dissertation project investigates the validity of test score interpretation and use of the English Placement Test (EPT) used at Iowa State University (ISU) under an argument-based validity framework. More specifically, this study started with an interpretation and use argument for the EPT, which states the score meaning and intended impact of the EPT explicitly, and focused on the last two inferences in the interpretation and use argument, namely extrapolation and ramification. The extrapolation inference links expected scores of the EPT (scores that exhibit adequate test reliability) to target scores or actual performance in the target domain. In this study, the extrapolation inference requires investigation of the relationship between ESL students’ English placement test performance and two external criteria of English performance, including the TOEFL iBT and a self-assessment. The ramification inference links the use of the EPT results to its actual impact and in this study the ramification inference requires investigation of the impact of the placement decisions in a specific educational context. For the extrapolation inference, quantitative data such as test performance data on the EPT, the TOEFL iBT, and the self-assessment were collected and analyzed using multitrait-multimethod (MTMM) analysis techniques. The findings indicated that the EPT was found to have moderate relationships with the TOEFL iBT and weak to moderate relationships with the self-assessment. The EPT showed some of the expected convergent correlations as well as discriminant correlations based on the MTMM correlation coefficient matrix as well as the factor loading parameters in a correlated trait-correlated uniqueness (CTCU) model. For the ramification inference, three types of analyses were conducted to seek support with regard to 1) test stakeholders’ perceptions of the EPT placement decisions, 2) the impact of the EPT placement on ESL students’ English learning, and 3) the relationship between ESL students’ EPT performance and their first-semester academic achievement. The interviews with test stakeholders were coded and analyzed to identify statements indicating their perceptions of the impact of the placement decisions. The qualitative findings are also utilized to help interpret the quantitative findings. Multiple paired-samples t-tests are used to investigate ESL students’ progress in the ESL courses that they were placed into. In addition, a structural equation modeling (SEM) approach was used to model the relationship among students’ performance on the EPT, ESL courses, and their first-semester GPA, mediated by individual difference constructs, such as learning motivation, academic self-efficacy, and self-regulated learning strategies. The qualitative analyses of the interviews with four groups of test stakeholders show that the interviewed ESL students in general experienced initial frustration regarding the placement decisions, in retrospect, they understood why they were placed into ESL courses and appreciated the benefits of taking the required courses, especially ESL writing courses. The ESL course instructors were satisfied with the placement accuracy, even though occasionally they identified a few cases of potentially misplaced students in the ESL courses. The interviewed undergraduate academic advisors showed positive perceptions of the EPT and the placement decisions. They also reported observing that the majority of the ESL advisees were receptive to the EPT placement decisions. The analyses of ESL course performance data collected at the beginning and the end of the course indicate that ESL students in Engl99L, an ESL listening course focusing on listening strategies, made statistically significant progress in terms of score gain on the same listening test administered at two time points. However, only nine out of 38 ESL students made satisfactory progress with reference to the course standard. Students in Engl101B (a lower-level ESL academic English writing course) and Engl101C (a higher-level ESL academic English writing course) did not show much progress in terms of lexical complexity, syntactic complexity, and grammatical accuracy. However, the Engl101C students on average wrote longer essays at the end of the course. Based on the ratings of the essays written in the final exams using the EPT scoring rubric, 14 out 18 Engl101B students (77.8%) and eight out of 16 Engl101C students (50%) showed satisfactory progress in these classes and were deemed ready for the next level of English study. The SEM analysis results indicate that ESL students’ EPT performance had significant and direct impact on their academic achievement. What’s more, students’ EPT performance predicted their academic self-efficacy and affected extrinsic goal orientation. However, these motivational factors did not have direct impact on academic achievement. The findings in this study contribute to building the validity argument for the EPT with two of the assumptions underlying the warrant for the extrapolation inference and ramification inference found supported and the other three partially supported. This findings in this study contributed to a better understanding of the score interpretation and use of the EPT at Iowa State University through constructing a validity argument. These findings shed light on the future development of the EPT and other similar English placement tests. The findings in this study as well as the research methodology can be informative for other institutions where English placement tests are used.
|
|
Keyword:
academic achievement; and Multicultural Education; and Research; Applied Linguistics and Technology; argument-based approach to validation; Bilingual; Educational Assessment; English Language and Literature; English placement tests; Evaluation; Higher Education Administration; Higher Education and Teaching; motivational factors; Multilingual; self-assessment; test stakeholders
|
|
URL: https://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=5545&context=etd https://lib.dr.iastate.edu/etd/14538
|
|
BASE
|
|
Hide details
|
|
50 |
Kompetenz von Lehramtsstudierenden in Deutsch als Zweitsprache. Validierung des GSL-Testinstruments ...
|
|
|
|
BASE
|
|
Show details
|
|
51 |
Pediatric Audiological Evaluation
|
|
|
|
In: ETSU Faculty Works (2015)
|
|
BASE
|
|
Show details
|
|
52 |
Mobile Active Authentication via Linguistic Modalities
|
|
|
|
In: DTIC (2015)
|
|
BASE
|
|
Show details
|
|
53 |
Methods for Evaluating Text Extraction Toolkits: An Exploratory Investigation
|
|
|
|
In: DTIC (2015)
|
|
BASE
|
|
Show details
|
|
54 |
Respirator Speech Intelligibility Testing with an Experienced Speaker
|
|
|
|
In: DTIC (2015)
|
|
BASE
|
|
Show details
|
|
55 |
La percepción del habla en ruido: un reto para la lingüística y para la evaluación audiológica (estudio experimental)
|
|
|
|
In: Revista Española de Lingüística, ISSN 2254-8769, Año nº 45, Fasc. 1, 2015 (Ejemplar dedicado a: Percepción del habla), pags. 129-151 (2015)
|
|
BASE
|
|
Show details
|
|
56 |
Evaluation eines 2-jährigen Sprachförderprogramms für Grundschüler nicht-deutscher Erstsprache
|
|
|
|
In: Sallat, Stephan [Hrsg.]; Spreer, Markus [Hrsg.]; Glück, Christian W. [Hrsg.]: Sprache professionell fördern. Idstein : Schulz-Kirchner Verlag 2014, S. 368-375 (2014)
|
|
BASE
|
|
Show details
|
|
57 |
A test of productive English grammatical ability in academic writing: Development and validation
|
|
|
|
In: Graduate Theses and Dissertations (2014)
|
|
BASE
|
|
Show details
|
|
58 |
Evaluation eines 2-jährigen Sprachförderprogramms für Grundschüler nicht-deutscher Erstsprache ...
|
|
|
|
BASE
|
|
Show details
|
|
59 |
How Autism Affects Speech Understanding in Multitalker Environments
|
|
|
|
In: DTIC (2014)
|
|
BASE
|
|
Show details
|
|
60 |
Integrated Cognitive-neuroscience Architectures for Understanding Sensemaking (ICArUS): Transition to the Intelligence Community
|
|
|
|
In: DTIC (2014)
|
|
BASE
|
|
Show details
|
|
|
|